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[57] ABSTRACT 

A conrputer-implemented method and system for browsing 
encoded images. According to a preferred embodiment at 
least one image is encoded with an encoding system to 
provide at least one encoded image. The encoding includes 
transforming images of the at least one image in accordance 
with a transform to provide a plurality of transform coeffi- 
cients. A subset of the plurality of transform coefficients 
corresponding to a selected image is transmitted to a remote 
computer system, wherein the subset of the plurality of 
transform coefficients corresponds to a low quality version 
of the selected image. 

24 Claims, 6 Drawing Sheets 
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FIGURE 5. ZIG-ZAG SCAN SEQUENCE 
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EFFICIENT BROWSING OF ENCODED consequently requires less bandwidth to transmit because it 

IMAGES may be represented by fewer bits. Mode (1). utilizing an icon 

to represent an image and only transmitting the image upon 

BACKGROUND OF THE INVENTION request, presents the user with a limited range of options: 

5 either free up bandwidth but omit viewing me image, or 

1. Held of the Invention choose to view the image at the cost of tying up commu- 
The present invention relates to video processing and, in nications channel bandwidth and enduring the delay of 

particular, to computer-implemented processes and appara- transmitting the image. Mode (2). storing separate GfJF or 
tuses for efficient browsing of encoded images. other format versions of an image, involves the drawback of 

2. Description of the Related Art 10 "XP™* CTtra « wcU as mc complexity of 
^ „ T T, „r.* „, ^ , . having extra layers of encoding and decoding formats. 
The World Wide Web (WWW) is a hypertext aocument is hc ^ therefore, are comr^-iinplemented 

network miplemented on top of the internet It allows processes and apparatuses for efficient browsingof encoded 
hypertext linking of multimedia documents containing text, images that avoids these problems- 
sound, images, and video across computers connected to the 

internet world wide. Other information services such as 15 SUMMARY 
CompuServe™, America Online™, and countless Bulletin There is provided herein a computer-implemented method 
Board Services (BBS's) also have large databases of still and system for browsing encoded images. According to a 
images. Many of the still images included in such databases preferred embodiment of the invention, at least one image is 
are encoded using the Joint Photographic Experts Group encoded with an encoding system to provide at least one 
(JPEG) standard which is an international Organization for 20 encoded image. The encoding includes transforming images 
Standardization (ISO) standard for compression of still of the at least one image in accordance with a transform to 
images based on discrete cosine transform (DCT), provide a plurality of transform coefficients. A subset of the 
quantization, and entropy coding (ISO Draft International plurality of transform coefficients corresponding to a 
Standard 10918-1). The JPEG standard is described in selected image is transmitted to a remote computer system, 
William B. Pcnnebaker & Joan L. Mitchell, JPEG: Still 25 wherein the subset of the plurality of transform coefficients 
Image Data Compression Standard (New York: Van Nos- corresponds to a low quality version of the selected image. 
d^dRdnhold, 1993), the entirety of which is incorporated BRIEF DESCRIPTION OF THE DRAWINGS 

herein by reference. 

Graphics interface format (GIF) has been a widely used ^ f»* aspects and advantagesof the 

file fo^Tfor image databases and is still used today for 30 ^ t ^ n ^L WlU bccxmic^ fully apparent from the 
efficient coding of images with few colors such as logos, f ^T^ ^ ' accompanying 

weather maps, and other images with limited a limited set of win8S m wlucft * 

colors. JPEG, however, is rapidly becoming a standard . * k a computer-based encoding system for encoding 
format for full color still image compression and decom- unage sl S aal ^ according to a preferred embodiment of the 
pressioiL 33 present invention; 

Image data may be transmitted to one or more remote FIG. 2 is a compute^ d^oding for decoding 

signal processing systems such as video conferencing nodes * e C *?%^! TT °* ™I 

which decode the encoded signals, or a personal computer h ac ^ dm « to a Preferred anbodnnent of me present 
communicating remotely with a host computer of a com- m a _ , 

puter or BBS service. Video conferencing or other nodes 3 13 a P 100588 n ° w digram of the encoding pro- 

may be personal computer (FC>-based systems coinmuni- cessin 8 implemented by the encoding system of FIG. 1, in 
eating with each other over a selected transmission medium, accordance with the present invention; 
Possible transmission media include Integrated Services FKJ * 4 is a block diagram of the encode processing of 
Digital Network (ISDN) and Public Switched Telephone * 

Network (PSTN) telephone connections. Although ISDN FIG. 5 shows the zig-zag scan sequence used in the 
connections provide a higher bandwidth than PSTN encode processing of FIG. 3; and 
connections, ISDN connections are currently less readily FIG. 6 is a block diagram of the decode processing of the 
available and more expensive than PSTN connections. decoding system of FIG. 2. 

Because of limited bandwidth availability on many so DESCRIPTION OF THE PREFERRED 

conn e cti o ns, whether by network connection or by modem EMBODIMENT 
connection, browsing these multimedia documents or ^vedon describes a & efficiently request- 

images in general can be inconveniently slow due to the . j . . ,_~ ,~T~7. ~i/ ^ 

m*d to transmit the entire JPEG encoded image « the us<x l^^^g^^reso^.toumbnafl v^onof ^ 
scrolls through the document, or as the userre^iests another „ ^• < ^J^ *Lf n . coded ^ * '"""jS?* 

image to beWsedorWewed. " ^T.l^ ""^ T*" ™ * 

* remotely-located computer system. The thumbnail version 

To avoid this pfoblein,brcrwsw wouM provide sufficient detail for the user to determine if he 

video or mul ti me di a conimunications systems, including a ^ ^ wanted to see the full resolution image. The present 

very popular one called Mosaic which is available on Unix, invention can also be used for browsing image databases on 

Mac, and PC platforms, typically operate in one of two 60 information services or computer communications 

modes: either they (1) display an icon representing a par- systems such as conferencing systems. Methods and appa- 

ticular image and only download the image when requested for performing these functions are described In 

by the user, or (2) they store a separate G^ c* other format further detail hereinbelow. 
version of the image that functions as a thumbnail image and 

requires less bandwidth to transmit As will be understood, 63 Video Processing System Hardware 

a thumbnail image is an image of lower resolution or quality Referring now to FIG. 1, there is shown a computer-based 

than the original image from which it is derived, which encoding system lit for encoding image signals, according 
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to a preferred embodiment of the present invention. As will may correspond, for example, to raw captured images ox 

be understood, encoding system 100 may be a remote companded images (Le., the results of decoding the encoded 

computer system storing an image database. Decoding sys- images). 

tern 200 (described below) may represent the computer Referring now the FIG. 2, there is shown a computer- 
system of a user who is remotely connected via a comma- 5 based decoding system 200 for decoding the image signals 
mentions channel to encoding system 100. As will be encoded by encoding system 100 of FIG. L, according to a 
onderstood. while decoding system 2H is communicating preferred embodiment of the present invention. Encoded 
via the c^ununications channel with encoding system 100, |W m tnmsmmed ^ J^™*^ 
image signals representing various images stored within device 212 or receiver 210 via systembus 206 for storage to 

200 for viewing or browsing by a user of decoding system pSTT 

200, or for other image processing by decoding system 200. . . . 

, ^. . * ~v * \ M * Host processor 208 accesses the encoded image signals 

Analog-tcMhgital {AID) converter 102 ofcncoding sys- ^ ho ^ mcmar ^ 2 14 via system bus 206. Host processor 

tern 100 receives analog image signals from an image 208 dccodcs ^ cncodcd ^5 ^ 5^ the 

source. The linage source may be any suitable source* « dccodcdima ^ c ^^^^ 2 14. Decoding 

analog image signals such as a still or video camera or VCR encJimage signals involves undoing the compres- 

for generating local analog image sfcnafc or a cable or ^ ^^^JSZmA. ^ Q0St pressor 116 of 

antenna for receiving a^ogimage signals from a remote ^ 10# of FIG. 1. The decoded image signals 

source. AJD converter 102 decodes (1^, separates die signal then transnntted to display processor 202 via system bus 

into constituent components) and digitizes each analog 20 ^ processor 202 converts the digital decoded 

image into digital image component signals (e.g in a image signals to analog image signals for display on monitor 

preferred embodiment Y, U, and V component signals). ^04 

Capture processor 104 receives, captures, and stores the Referring again to FIG. 1, encoding system 100 is pref- 

digWzed component signals as subsampled images in host a general nucroprocessor-based personal computer 

memory 112 via bus 100, bus interface 110, and system bus (pQ system ^th a sp^-purpose image capture plug-in 

114. Each subsampled image is represented by a set of board. In particular, A/D converter 102 may be any suitable 

twcMiimensional component planes or pixd bitmaps, one for m eans for decoding and digitizing analog video image 

each component of the digitized image signals. In a pre- signals. Capture processor 104 may be any suitable proces- 

ferred embodiment capture processor 104 captures image S or for capturing digitized video image component signals as 

signals in a YUV4: 1: 1 format in which every (4x4) block of SU bsampied frames. Bus 100 may be any suitable digital 

pixels of the Y component plane corresponds to a single signal transfer device and is preferably a peripheral compo- 

pixel in the U component plane and a single pixel in the V nent interconnect (PO) bus. Alternatively, bus 100 may be 

component plane. an industry Standard Architecture (ISA) bus or Extended 

Host processor 116 accesses captured bitmaps from host 35 isa (EISA) bus. Bus interface 110 may be any suitable 
memory 112 via system bus 114 and generates encoded means for mtcrfacing between bus 108 and system bus 114. 
image signals that represent one or more of the captured in a preferred embodiment A/D converter 102, capture 
images. Depending upon the particular encoding method processor 104, bus 108, and bus interface 110 are contained 
implemented, host processor 116 applies a sequence of m a single plug-in board, such as an Intel® Smart Video 
compression techniques to reduce the amount of data used to ^ Recorder board, capable of being added to a general 
represent the information in each image. Host processor 116 microprocessor-based personal computer (PC) system, 
stores the encoded image signals back to host memory 112 rj 0 st processor 116 may be any suitable means for con- 
via system bus 114. Host processor 116 may transmit the trolling the operations of the specialixupose video process- 
encoded image signals to transmitter 118 for real-time ^g board and Is preferably an Intel® general purpose 
transmission to a remote receiver (not shown in FIG. 1), 4J processor such as an Intel® i386™, i486™, or Pentium™ 
store the eocoded image signals to mass storage device 120 processor. Host memory 112 may be any suitable memory 
for future processing, or both. A plurality of encoded image device used in conjunction With host processor 116 and is 
signals stored withinmass storage device 120 tos represent preferably a commnation of raridcrn access memory (RAM) 
a database 150 of encoded image signals, representing and read-only memory (ROM). System bos 114 may be any 
various images or pictures. It will be understood that data- ^ suitable digital signal transfer device and is preferably a 
base 130 may comprise encoded image signals generated by high-speed data bus such as a PCI bus. Mass storage device 
means other man analog-to-digital converter 102, for 120 may be any suitable means for storing digital signals and 
example digitally-generated or processed still images. It will is preferably a computer hard drive. Transmitter 118 may be 
further be understood that host memory 112 or other suitable suitable means for transmittiiig di gital signals to a 
memory means may instead be utilized to store an image 55 remote receiver and is preferably a modem for transmitting 
database. Additionally, a database of unencoded image sig- digital signals over Public Switched Telephone Network 
nab may also be stored within a memory device such as (PSTN) lines. Those skilled in the art wuT understand that 
mass storage device 120. the encoded image gign*i« may be transmitted using any 

The encoding technique utilized by host processor 116 to suitable means of transmission such as telephone line (PSTN 

compress the image signals is described in further detail & or Integrated Services Digital Network (ISDN)), RF 

hereinbelow in the section captioned "Encoding Process- antenna, local area network, or remote area network, 

fog". Display processor 122 may be any suitable device for 

In addition to encoding and transmitting image signals, converting digital image signals to analog image signals and 

display processor 122 may receive and process digital image is preferably implemented through a personal computer 

signals for display in one or more windows on monitor 124. 65 (PQ-based display system such as a VGA ox SVGA system. 

Display processor 122 converts the digital image signals to Monitor 204 may beany means for displaying analog image 

analog image signals. The images displayed on monitor 124 signals and is preferably a VGA monitor. 
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Referring now to FIG. 2, decoding system 2*6 is prefer- Rate controller 306 adjusts the bit rate by varying the 
ably a general microprocessor-based personal computer quantization levels to be applied to the DCT coefficients of 
(PC) system similar to the basic PC system of encoding die transformed video image in the following-described 
system 100. In particular, host processor 208 may be any manner. If a first encoded picture yields an encoded bit- 
suitable means fox decoding and scaling encoded image 5 stream having more bits than the target bitstream size far 
signals and is preferably an Intel® general purpose proces- that picture, a coarser (Le., generally higher) quantization 
sot such as an intel$ 086™, i486™, or Pentium™ proces- level may be applied to the next picture in order to reduce 
sol Host memory 214 may be any suitable memory device mc bit rate so mat the average bit rate approaches the target 
used in conjunction with host processor 268 and is [refer- bitstream rate. Thus, as will be understood by those skilled 
ably a combination of random access memory (RAM) and 10 a * mer ** 0021 80 quantization level may be used 

read-only memory (ROM). to increase or decrease the target bitstream rate. In 

System bus 2*6 may be any suitable digital signal transfer quantization, each DCT coefficient of the coefficients of a 
device and is preferably a high-speed data bus suchasaPO transformed (8x8) block is divided by the quantization 
bus. Mass storage device 212 may be any suitable means for factor m ^ <»nesponding (8x8) block position of the 
storing digital signals and is preferably a CD-ROM device. 15 applicable quantization table, and then either rounded to the 
Receiver 210 may be any suitable means for receiving the nearest number or the fractional part is truncated. When 
digital si gnals irarxmirtM hy ftynffmittfr 118 of flnroding DCT coefficients are scaled down in this manner by dividing 
system 100. Display processor 202 may be any suitable bv a quantization factor, many of mem become zeros, 
device for converting digital image signals to analog image making them easier to represent with fewer bits, for example 
signals and is preferably im pim^ntH through a personal 20 bv ""^^g* encoding applied to the bitstream after the 
computer (PQ-based display system such as a VGA or encoder stage 304. 

SVGA system. Monitor 204 may be any means for display- Each block may be guantized using different quantization 
ing analog image signals and is preferably a VGA monitor. levels. Typically, however, each (8xg) block within a niac- 
in a preferred embodiment, encoding system 100 of FIG. roblock is quantized at the same quantization leva. As will 
1 and decoding system 200 of FIG. 2 are two distinct 25 1x1 understood, a macroblock comprises a (16x16) array of 
computer systems. In an alternative preferred embodiment Y l™mnance pixels (also known as turna pels*) and two 
of the present invention, a single computer system compris- associated (8x8) blocks of chroma information, the U and V 
ing all of the different components of systems 100 and 200 P«els* The (16x16) luma array is further divided into four 
may be used to encoded and decoded video image signals, ( 8x **) blocks. Other macroblock configurations are also 
In a preferred embedment encoding system 100 stores » pw*tok. such as niacrottocks comprising sixteen (8x8) 
an encoded image database 130 in such a manner as to Wocks *** Y component plane, the conesponding (8x8) 
transmit low resolution image signals to decoding system Wock <* u com P onent Md curesponding 

200 for efficient browsing of images of database 130 by a ( 8x *> block <*f me V component plane. Thus, quantization 
user of decoding system 200, as described in further detail levels are usually chosen on a macroblock level, and this 
hereinbelow. 35 quantization level is applied to each block within the mac- 

roblock. The selection of which quantization level will be 
Encoding Processing used is part of the bit rate control in the compression 

Referring now to FIG. 3, there is shown a process flow processing of the present invention, 
diagram of the encoding processing implrrrtffntrd hy capture As will be understood, when a DCT is performed on an 
processor 104 and host processor 116 of FIG. 1, according 40 (8*8) block of an image, the 64 coefficients are arranged in 
to a preferred embodiment of the present invention. As zig-zag fashion from the upper left corner of an (8x8) block 
shown in FIG. 3, capture processor 104 of FIG. 1 captures down to the lower right corner, as described below in further 
and dig it izes video image signals to provide a digitized detail with reference to FIG. 5. When arranged mis way. the 
video image signal 301. As described above, video image upper left corner of a block of DCT coefficients contain the 
signal 301 is a single picture of video data, which may be a 45 DC component and lower frequency coefficients of the 
still image or one of a plurality of pictures that constitute transformed block, while the lower right corner contains the 
motion video. Capture processor 104 further p erforms the higher frequency components of the transformed block 
subsampling 302 of digitized image 301 to provide a Larger quantization factors are grouped in the lower right 
subsampled, digitized video image comprising an array of regions of the each quantization table corresponding to a 
pixels. At this point the pixel array is broken up into 5© quantization Level, while smaller divisors are grouped in the 
subimages or blocks of (8x8) pixels which are indepen- upper left region of the a table. In mis manner higher 
dentfy encoded further. frequency coefficients tend to be divided by larger divisors 

Encoder 304, also under control of rate controller 306, than DC component and lower frequency components, 
applies a transform such as a DCT to the subimage blocks 'Hie reason for mis weighting is that loss of information in 
and quantizes the DCT coefficients at a determined quanti- 55 the higher frequency ranges is less visible to human visual 
zation level, as described in further detail below with r>erception than is loss of iriforrnation in the lower frequency 
reference to FIG. 4. Buffer 305 next receives the encoded ranges. 

bitstream representing the quantized DCT coefficients for In the present invention rate controller 306 preferably 
transmission via the transmission raratiiim to a destination generates encoded images in accordance with the encode 
source. It will be understood by those skilled in the art that, 60 processing steps illustrated in FIG. 4. 
in a preferred embodiment, the functional elements of the Referring now to FIG. 4. mere is shown a block diagram 
process flow diagram of FIG. 3 are implemented by capture illustrating the encode processing of FIG. 3 in further detail, 
processor 104 and host processor 116 of FIG. 1. Those according to one embodiment of the present invention. A 
skilled in the art will further appreciate that additional forward block transform 406 is applied to each block of the 
processing may be applied to video image signal 301 at or 65 source image to generate transformed coefficients. In a 
after the encoder 304 stage, such as motion estimation, inter- preferred embodiment, transform 406 is a DCT transform. In 
or intrapicture encoding, and run-length encoding. alternative embodiments, transform 406 may be a different 
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transform such as, but not limited to, a on©- or two- of a tree, successive bits of a code word are received from 
dimensional slant transform, a one- or two-dimensional the encoded bitstream. Depending on whether the bit is a 0 
Haar transform, or a hybrid transform. ox 1, the decoder branches down to a node of the tree to the 

Quantizer 408 quantizes the transformed coefficients to left or right thereby traversing the tree. When a terminal 
generate quantized coefficients for the current block Quan- * node or leaf of the binary tree is n^ed. the traversal is 
tizer4W divides each cc<ffi^ complete and the decoded value of the symbol is o^ternined 

factor as Described rjereinabove. from a table. 

Zig-zag run-length encoder 410 transforms the quantized Decoding Processing 

coefficients into run-length encoded (RLE) data. In a pre- tri t 
ferred embodiment, the RLE data for each block of quan- 10 Referring now to FIG. 6, there is shown a block diagram 
tized coefficients consist of a sequence of run/val pairs, of the decode processing of decoding system 200 of FIG. 2, 
where each run/val pair is a non-zero quantized coefficient according to one embodiment of the present invention. The 
value followed by a value corresponding to a run of zero decode processing of FIG. 6 reverses the encode processing 
quantized coefficients. The run-length encoding follows a of FIG. 4. In particular, Huffman decoder 602 applies 
zig-zag pattern from the upper-left corner of the block of 13 Huffman-type entropy decoding to the encoded image sig- 
quantized coefficients (i.e., the DC coefficient of the DCT nals to reconstruct the run-length encoded run/val data, 
transform) to the lower-right comer (Le., the highest fre- Unzig-zag run-length decoder 604 transforms the RLE data 
quency coefficient of the DCT transform), as illustrated in into quantized coefficients. Inverse quantizer 606 dequan- 
FIG. 5. Those skilled in the art wfll understand that using the tizes the quantized coefficients to generate dequantized 
zig-zag pattern provides a long run of zero coefficients for 20 coefficients- Inverse block transform 608 applies the inverse 
the last run of the block. of forward block transform 406 to the dequantized coeffi- 

Huffman encoder 412 applies Huffman-type entropy (ie., to mc **** 

statistical or variable-length) coding to the RLE data to Browsing 
generate the encoded data for the current block or image, as 

described immediately below. In a preferred embodiment the above-described encoding 

and decoding techniques are in compliance with the JPEG 
Huffman Encoding standard. This present invention provides for the efficient 

A string of symbols (such as quantized discrete cosine pneration of a low^esolution version of a high resolution 
transform (DCIO coefficients representative of an image) to 30 image cc*npressed in a JPEG or similar compression for^L 
be encoded is s<L*rnes referS toas a message, which is 30 P 115 ^7**°° ^ °**J ^ZT * 
to be encoded into code words. There is usually a statistical browsmg a database of document ""^Z™/*^ 
probability distribution among the symbols ccHistituting the m cases of limited transirdssion^banoVidm. When the user 
set^mbols constituting a* rnessa^Such syrnbob are ^tifies an image of interest, theuser can request that the 
often encoded and decoded using variable-length coding 35 ™* resolutio0 image be transmitted. 
(VLC). Symbols are encoded into an encoded bitstream One method to generate a lower resolution version of a 
containing code words, and the association of symbols and JFEG-encoded still image is to decode the image into a full 
code words is referred to as the code. In VLC techniques, color bitmap representation, filter andresample it at a lower 
code words of varying bit lengths are transmitted or stored resolution, and then recompress and transmit this lower 
for each symbol rather than transmitting or storing the 40 resolution image. This involves the disadvantages refer- 
symbol itself, with more common or probable symbols enced previously, however. The invention exploits certain 
being represented by code words with a relatively small features of two-dimensional transforms, such as the DCT, 
number of bits, and less probable symbols represented by used in standards such as JPEG. In JPEG, each (8x8) pixel 
code words with a relatively large number of bits. Because block from the image is transformed into an (8x8) frequency 
more common symbols need to be encoded more often than 45 domain representation after which quantization and entropy 
less probable symbols, efficiency in terms of encoded bits encoding is applied; as explained above, 
can be achieved if the code is constructed to accu r ately However, as will be appreciated, during mis encoding the 
account for the statistics of the symbol set of the messages) DCT operation already provides a breakdown of the image 
being encoded. Such encoding techniques are described in into multiple frequency bands. Thus, it is possible to recon- 
chapters 8 and 11 of Pennebaker & Mitchell, JPEG: SHU jq struct a lower resolution version of the image directly from 
Image Data Compression Standard, referenced above. this frequency domain representation. In particular, the DC 

One method known in the priorart for statistically encod- cc*nponent of each of the (8x8) frequency domain repre- 
ing symbols in this manner is the use of an optimal VLC sentation of each (8x8) pixel block may easily be extracted 
such as a Huffman code. To use a Huffman code, a symbol in order to construct a so-called "mumbnaiT version of the 
set representative of typical messages to be encoded is put 55 image, for example which is one-eighth the resolution of the 
in order, from the most frequently occurring symbols to the original image in both the horizontal and vertical dimensioiL 
least frequently occurring symbols. A Huffman code is men Therefore, In a preferred embodiment of the invention, 
generated using, for example, the algorithm described at efficient browsing of images is provided as follows* A user 
pages 77-85 of Information Theory and Coding by N. of decoding system 200 is provided with an option to view 
Abramson, McGraw HilL 1963, pages 77-85 of which are eo at least one image, which is stored remotely at encoding 
incorporated by reference herein. The code is typically system 100. For example, an icon representing an image 
stored, in bom encoders and decoders, in a code table. The stored at encoding system 100 is shown on monitor 204 of 
Huffman code or tree is then used in both encoding symbols decoding system 200. If the user selects the icon, decoding 
into code words and in decoding the code words back into system 200 requests a thumbnail, Le. low resolution, version 
symbols. 65 of the corresponding image from encoding system 100. 

Conventional methods for decoding Huffman and other Encoding system 100 then transmits only the DC coeffi- 
VLCs represent the codes as binary trees. Starting at the root dents of the DCT coefficients of die image, i.e. one per 
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block or macroblock. which arc readily available because of It will farther be understood that thumbnail images of 

the encode processing of FIG. 4. These DC coefficients are varying levels of quality may be created by selecting subsets 

transmitted to decoding system 200 where they may be of the DCT coefficients other than soldy the DC DCT 

decoded. As will be understood, the image resulting there- coefficients. For example, an even lower quality thumbnail 

from will represent a low resolution version of the original 3 image may be achieved by transmitting only one of every 

image, and may be displayed on monitor 264. Ahbougb mis four DC DCT coefficients, or an equivalent average, A 

mumbnail image is of relatively low quality and resolution, higher quality mumbnail image may be achieved by encod- 

usually enough kfonnation wfll be present for the user to ing the DC and first order AC DCT coefficients, and so on. 

see roughly what the full-quaKty image wffl represent where more than one such level of thumbnail images is 

Therefore, at mis point, after viewing the low resolution io possible, the user of decoding system 200 may be presented 

version of the image, the user may request me high-quality with an option to selected the mumbnail image of the desired 

version of the image, for example by selecting another quality, although higher quality thumbnail images will 

option or icon as before. Alternatively, if the mumbnail require, in general, more communicatioos bandwidth to 
image does not look interesting, the user can avoid request- 

transmit* 

«?^l h i!?T^ VOTk5n " ad J h !f aV "? Sf^f T 15 * "01 ***** ** undmlood that, in alternative preferred 

warn bandwi^ j^ssaor to transmit fte full-qaahty enSbodilaa ^ Ac request for aflLatmail imagery be 

encoded image. At this point the user may browse another I "7 ^ „_ . , * . J 

. . r!r^ \T Zr J , vT generated automatically by decoding system 200 whenever 

image ui the same fashion as before by selectme another , _ * . _ <AA 

^ ^. . J ouvuia a user selects an image for viewing, or encoding system 100 

icon representing another image. m ^ oooh&SIcd to always ^ me mumbciafl 

In a preferred embaliment of the present invention, an image followed by the high quality image if requested, 
decoding system 200 uses a smoothing filter to display me 

lower-resolution thumbnail image so that blocltiness arti- Transmitting the Full-Quality Image 
facts are reduced. 

r ^. AV . ..... After receiving and viewing the thumbnail image, the user 

In this manner, the present i^onn^ video data- the foil quality version of the linage^ a higher 

bases easier to use given fce limited ba^widths available to 25 ^^ vcrsioiu M Lcribed above. In oTernbc^nU 

rr^computer uses partic^fo the use of home com- CDCodin ^ stem m ^yt^^ mc ^ 

^vl^^ ^ fomatl0n enco^irnage. However; in alternative preferred embedi- 

saviccs. By aDowing users to browse 1™ ration images ^ cnc ^ ^ lf0 recognizes thaVa portion of the 

before requesting the txansmission of high resolution ^ €QtiBd ^ 9 hm r^transinirted with the 

encoded sisals, the user can de^ewhich images are 30 mumbiudl ^ md mus ^^^TTiS£ 

^T^Z USe *i CDOUgh to DCT cceffiS to allow decoding system^ to build the 

U^nsmission of further data over the comnuimcations band- ^ quality txom te^r^dy-received thumbnail 



version. 

33 Motion Video Sequences 



Transmitting the Thumbnail Image 

As will be understood, when encoding system 10* is 

requested to send the thumbnail version of an image, there As wiU be understood, the above-described invention may 

are several ways in which this may be accomplished. Refer- also be utilized to provide a thumbnail image of the first 

ring once more to FIG. 4, data may be extracted from frame of a sequence of video frames, to allow the user to 

various stages of the encode processing to transmit only a 40 browse a thumbnail image of the first frame to rtrririr 

subset of the DCT coefficients to decoding system 200. In a whether to receive the entire video sequence. Alternatively, 

preferred embodiment, enc o de d image produced at a "thumbnail video sequence" may be transmitted to allow 

step 412 are stored as encoded images in *t«tfthasf 130 of browsing of the video sequence itself, which comprises a 

encoding system 1##. When a thumbnail version of a given thumbnail version of each intracoded frame within the video 

encoded image stored in database 13* is requested to be 45 sequence. This would allow the viewer to efficiently preview 

transmitted to decoding system 200, ericoding system may tne movie before downloading (he entire sequence. Those 

simply reverse the huffman encoding, run-length encoding, skilled in the art will realize how to adapt the above- 

and zig-zag ordering of steps 412 and 41* to provide die described techniques to such a motion video environment 

quantized DCT coefficients, as shown in steps 414-418, The *uch as the ISO/TEC 11172 Moving Pictures Experts 

DC coefficients may then be selected and transmitted to 50 Groim ~ 1 (MFECM) standard, the entirety of which is incor- 

decoding system 200. As will be understood, this subset of porated herein by reference. 

guantized DCT coefficients may be farther encoded before ft will be understood that various changes in (he details* 

transmitting, for example run-length and Huffman encoded materials, and arrangements of the parts which have been 

Alternatively, as will be appreciated, encoder 408 can also described and illustrated above in order to explain the nature 

reverse the quantization of step 406 to provide the original 55 of this invention may be made by those skilled in the art 

set of DCT coefficients, and transmit only the DC coeffi- without departing from the principle and scope of the 

cients of this set to decoding system 290. invention as recited in Che following claims. 

As wfll furfcer be understood by those skilled in the art What is daimed is: 

in an alternative preferred embodiment during the original A computer-implemented method for browsing 

encoding of an image in the encode processing of FIG. 4, 60 encoded images, comprising the steps of: 

both a mumbnail image and the encoded image may be (a) encoding at least one image with an encoding system 

generated and stored in database 130. As shown by the to provide at least one encoded image, wherein the 

dashed line after step 4*8, the guantized coefficients can be encoding comprises the step of trarisfonning an image 

divided at mis point for both the full quality image and the of the at least one image in accordance with a transform 

thumbnail image. Thus, when the mumbnail image is 63 to provide a plurality of transform coefficients; 

requested, it may be retrieved dxrectfy from database 130 (b) quantizing the plurality of transform coefficients to 

and transmitted to decoding system 200. form a plurality of quantized transform coefficients: 
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(c) selecting a subset of the plurality of quantized trans- 
form coefficients corresponding to a selected image to 
form a subset of quantized transform coefficients; and 

(d) transmitting the subset of quantized transform coef- 
ficients to a remote computer system, wherein the 
subset of quantized transform coefficients corresponds 
to a low quality version of the selected image, the 
subset of quantized transform coe ffi c i e nts comprising 
Che DC components and the first-order AC components 
of the plurality of quantized transform coefficients. 

2. The method of claim 1, wherein the selected image is 
selected in accordance with a selection of a user of the 
remote computer system, the method further comprising the 
step of: 

(e) transmitting encoded image signals corresponding to a 
high quality version of the selected image to the remote 
computer system in response to a request by the user of 
the remote computer system. 

3. The method of claim 2, wherein the encoded image 
signals comprise the plurality of quantized transform coef- 
ficients. 

4. The method of claim 2, wherein the encoded image 
signals comprise quantized transform coefficients of the 
plurality of quantized transform coefficients other than the 
subset of quantized transform coefficients. 

5. An apparatus for browsing encoded images, compris- 
ing: 

(a) an encoder for encoding at least one image with an 
encoding apparatus to provide at least one encoded 
image, the encoder comprising means for transforming 
an image of the at least one image in accordance with 
a transform to provide a plurality of transform coeffi- 
cients; 

(b) means for quantizing the plurality of transform coef- 
ficients to form a plurality of quantized transform 
coefficients; 

(c) means for selecting a subset of the plurality of quan- 
tized transform coefficients corresponding to a selected 
image to form a subset of quantized transform coeffi- 
cients; and 

(d) means for transmitting the subset of quantized trans- 
form coefficients to a remote computer system, wherein 
the subset of quantized transform coefficients corre- 
sponds to a low quality version of the selected image, 
the subset of quantized transform coefficients compris- 
ing the DC components and the first-order AC compo- 
nents of the plurality of quantized transform coeffi- 
cients. 

6. The apparatus of claim 3, wherein the selected image 
is selected in accordance with a selection of a user of the 
remote computer apparatus, the apparatus further compris- 
ing: 

(e) means for transmitting encoded image signals corre- 
sponding to a high quality version of the selected image 
to the remote computer apparatus in response to a 
request by the user of the remote computer apparatus. 

7. The apparatus of claim 6\ wherein the encoded image 
signals comprise the plurality of quantized transform coef- 
ficients. 

8. The apparatus of claim 6. wherein the encoded image 
gjgrmlg comprise quantized transform coefficients of the 
plurality of quantized transform coefficients other than the 
subset of quantized transform coefficients. 

9. A computer-readable memory device having stored 
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(a) encoding at least one image with an encoding system 
to provide at least one encoded image, wherein (he 
encoding comprises the step of transforming an image 
of the at least one image in accordance with a transform 
to provide a plurality of transform coefficients; 

(b) quantizing the plurality of transform coefficients to 
form a plurality of quantized transform coefficients; 

(c) selecting a subset of the plurality of quantized trans- 
form coefficients ccrresponding to a selected image to 
form a subset of quantized transform coefficients; and 

(d) transmitting the subset of quantized transform coef- 
ficients to a remote computer system, wherein the 
subset of quantized transform coefficients corresponds 
to a low quality version of die selected image, the 
subset of quantized transform coefficients comprising 
the DC components and the first-order AC components 
of the plurality of quantized transform coefficients. 

It. The coniputer-readabie memory device of claim 9, 
wherein the selected image is selected in accordance with a 
selection of a user of the remote computer system and the 
plurality of instructions cause the processor to perform the 
step of: 

(e) transmitting encoded image signals corresponding to a 
high quality version of the selected image to the remote 
computer system in response to a request by the user of 
the remote computer system. 

LL The computcr-rcadabk memory device of claim 10, 
wherein the encoded image signals comprise the plurality of 
quantized transform coefficients. 

12. The conmuter-readabte memory device of claim 10, 
wherein the encoded image Mgn»u comprise quantized 
transform coefficients of the plurality of quantized transform 
coefficients other than the subset of quantized transform 
coefficients. 

13. A computer-implemented method for browsing 
encoded images, conmrising the steps of: 

(a) encoding at least one image with an encoding system 
to provide at least one encoded image, wherein the 
encoding comprises the step of transforming an image 
of the at least one image in accordance with a transform 
to provide a plurality of transform coefficients; step (a) 
comprising the steps of: 

(1) quantizing the plurality of transform coefficients to 
provide a plurality of quantized transform coeffi- 
cients; 

(2) run-length encoding the plurality of quantized trans- 
form coefficients; and 

(3) Huffman encoding the ran-lengm-encoded plurality 
of quantized transform coefficients; and 

(b) transmuting a subset of the plurality of quantized 
transform coefficients corresponding to a selected 
image to a remote computer system, wherein the subset 
corresponds to a low quality version of the selected 
image; step (b) comprising the steps of: 

(1) reversing the Huffman encoding of step (aX3) and 
the run-length encoding of step (aX2) to provide the 
plurality of quantized transform coefficients; and 

(2) selecting selected quantized transform coefficients 
of the plurality of quantized transform coefficients to 
form the subset of the plurality of transform coeffi- 
cients. 

14. Hie method of claim 13, wherein the selected image 
is selected in accordance with a selection of a user of the 



remote computer system, me method further comprising the 

thereon a plurality of instructions, wherein the plurality of 65 step of: 
instructions, when executed by a processor of a source (c) transmitting encoded image signals conrsponding to a 
computer, cause the processor to perform the steps of: high quality version of the selected image to the remote 
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computer system in response to a request by the user of 
the remote computer system. 

15. The method of claim 14, wherein the encoded image 
signals comprise the plurality of transform coefficients. 

16. The method of claim 14, wherein the encoded image 
signals comprise transform coefficients of the plurality of 
transform coefficients other man the subset of the plurality 
of transform coefficients. 

17. An apparatus for browsing encoded images, compris- 
ing: 

(a) an encoder for encoding at least one image with an 
encoding apparatus to provide at least one encoded 
image, the encoder comprising means for transforming 
an Image of the at least one image in accordance with 
a transform to provide a plurality of transform coeffi- 
cients; the encoder comprising; 

(1) means for quantizing the plurality of transform 
coefficients to provide a plurality of quantized trans- 
form coefficients; 

(2) means for run-length encoding the plurality of quan- 
tized transform coefficients; and 

(3) means for Huffman encoding the run-length-encoded 
plurality of quantized transform coefficients; and 

(b) means for transnritting a subset of the plurality of 
transform coefficients corresponding to a selected 
image to a remote computer apparatus, wherein the 
subset of the plurality of transform coefficients corre- 
sponds to a low quality version of the selected image; 
means (b) composing: 

(1) means reversing the Huffman encoding of means 
(aX3) and the run-length encoding of means (aX2) to 
provide the plurality of quantized transform coeffi- 
cients; and 
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transform coefficients other than the subset of the plurality 
of trans form coefficients. 

2L A computer-readable memory device having stored 
thereon a plurality of instructions, wherein the plurality of 
instructions, when executed by a processor of a source 
computer, cause the processor to perform the steps of: 

(a) encoding at least one image with an encoding system 
to provide at least one encoded image, wherein the 
encoding comprises the step of transforming an image 
of the at least one image in accordance with a transform 
to provide a plurality of transform coefficients; step (a) 
comprising the steps of: 

(1) quantizing the plurality of transform coefficients to 
provide a plurality of quantized transform coeffi- 
cients; 

(2) run-length encoding the plurality of quantized trans- 
form coefficients; and 

(3) Huffman encoding the run-lengm-cncoded plurality 
of quantized transform coefficients; and 

(b) transmitting a subset of the plurality of quantized 
transform coefficients corresponding to a selected 
image to a remote computer system* wherein the subset 
corresponds to a low quality version of the selected 
image; step (b) comprising the steps of: 

(1) reversing the Huffman encoding of step (aX3) and 
the run-length encoding of step <aX2) to provide the 
plurality of quantized transform coefficients; and 

(2) selecting selected (piantfred transform coefficients 
of the plurality of quantized transform coefficients to 
form the subset of the plurality of transform coeffi- 
cients. 

22. The computer-readable memory device of claim 21. 
wherein the selected image is selected in accordance with a 
selection of a user of the remote computer system and the 



(2) means for selecting selected quantized transform 35 plurality of instructions cause the processor to perform the 



coefficients of the plurality of quantized transform 
coefficients to form the subset of the plurality of 
transform coefficients. 

18. The apparatus of claim 17. wherein the selected image 
is selected in accordance with a selection of a user of the 
remote computer system, the apparatus further comprising: 

(c) means for transmitting encoded image signals corre- 
sponding to a high quality version of the selected image 
to the remote computer system in response to a request 
by the user of the remote computer system. 

19. The apparatus of claim 18, wherein the encoded image 
signals comprise the plurality of transform coefficients. 

20. The apparatus of claim 18, wherein the encoded image 
signals comprise transform coefficients of the plurality of 



step of: 

(c) transmitting encoded image signals corresponding to a 
high quality version of the selected image to the remote 
computer system in response to a request by the user of 
40 the remote computer system. 

23. The computer-readable memory device of claim 22, 
wherein the encoded image signals comprise the plurality of 
transform coefficients. 

24. The computer-readable memory device of claim 22, 
43 wherein the encoded image signals comprise transform 

coefficients of the plurality of transform coefficients other 
than the subset of the plurality of transform coefficients. 
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